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Constraint  Satisfaction  Problems 


What  is  Search  For? 

Assumptions  about  the  world:  a single  agent,  deterministic  actions, 
fully  observed  state,  discrete  state  space 


Planning:  sequences  of  actions 

The  path  to  the  goal  is  the  important  thing 
Paths  (Plans)  have  various  costs,  depths 
Heuristics  give  problem-specific  guidance 

Identification:  assignments  to  variables 
The  goal  itself  is  important,  not  the  path 
All  paths  at  the  same  depth  (for  some  formulations) 
CSPs  are  specialized  for  identification  problems 


Constraint  Satisfaction  Problems 


Constraint  Satisfaction  Problems 


Standard  search  problems: 

State  is  a “black  box”:  arbitrary  data  structure 
Goal  test  can  be  any  function  over  states  that  says  yes, 
this  is  a goal  or  no,  this  is  not. 

Successor  function  can  also  be  anything 


Constraint  satisfaction  problems  (CSPs): 

A special  subset  of  search  problems 

We  make  assumptions  about  what  exactly  goes  into  the 

state 

State  is  defined  by  variables  X,  with  values  from  a 
domain  D (sometimes  D depends  on  /) 

Goal  test  is  a set  of  constraints  specifying  allowable 
combinations  of  values  for  subsets  of  variables 

Simple  example  of  a formal  representation  language 

Allows  useful  general-purpose  algorithms  with  more  power 
than  standard  search  algorithms 


CSP  Examples 
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Example:  Map  Coloring 

► Variables:  WA,  NT,  Q,  NSW,  V,  SA,  T 

► Domains:  D = {red,  green,  blue} 

All  the  variables  have  the  same  domain 

Constraints:  adjacent  regions  must  have  different  colors 

Implicit:  WA  ^ NT 

Means  the  constraints  described  implicity  by  a code  snippet 

Explicit: (WA,  NT)  e {(red,  green),  (red,  blue), . . .} 

Means  we  actually  list  all  of  the  allowed  combinations  of 
assignments 

Solutions  are  assignments  satisfying  all  constraints,  e.g.: 

{WA=red,  NT=green,  Q=red,  NSW=green, 


Example:  N-Queens 


Formulation  1: 

► Variables:  ^ij 

Domains:  {0,1} 

The  square  is  either  queened  or  empty 
Constraints 


vi,),fc  (Xij,xik)  e {(0,0),  (0,1),  (1,0)} 

Vi.i.fc  (. Xij,Xkj ) € {(0,0),  (0,1),  (1,0)} 

Vi,),  k (X,3,Xi+kj+k)  € {(0,0),  (0,1),  (1,0)} 

(xi3,xi+kJ_k)  e {(0,0),  (0,1),  (1,0)} 


E % = 


hJ 


Example: 

Formulation  2: 
Variables: 

Domains: 

Constraints: 

Implicit: 


N-Queens 


Q 1 
Q2 
Q 3 
Qa 


Vi,j  non-threatening^,  Qj) 


Qk 

{1,2,3,. ..iV} 


Explicit: 


(Q1.Q2)  e {(1,3),  (1,4),...} 


Constraint  Graphs 


Constraint  Graphs 


Binary  CSP:  each  constraint  relates  (at  most) 
two  variables 


Binary  constraint  graph:  nodes  are  variables, 
arcs  show  constraints 


General-purpose  CSP  algorithms  use  the  graph 
structure  to  speed  up  search.  E.g.,  Tasmania  is 
an  independent  subproblem! 


Example:  Sudoku 
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Variables: 


■ Each  (open)  square 
Domains: 

- {1,2, ...,9} 

Constraints: 


9-way  alldiff  for  each  column 

9-way  alldiff  for  each  row 

9-way  alldiff  for  each  region 

(or  can  have  a bunch  of 
pairwise  inequality 
constraints) 


Example:  The  Waltz  Algorithm 


■ Approach: 

■ Each  intersection  is  a variable 

■ Adjacent  intersections  impose  constraints 
on  each  other 

■ Solutions  are  physically  realizable  3D 
interpretations 


The  Waltz  algorithm  is  for  interpreting  line 
drawings  of  solid  polyhedra  as  3D  objects 
► An  early  example  of  an  Al  computation 
posed  as  a CSP 


Example:  The  Waltz  Algorithm 


The  Waltz  algorithm  is  for  interpreting  line 
drawings  of  solid  polyhedra  as  3D  objects 
► An  early  example  of  an  Al  computation 
posed  as  a CSP 


Approach: 

■ Each  intersection  is  a variable 

■ Adjacent  intersections  impose  constraints 
on  each  other 

■ Solutions  are  physically  realizable  3D 
interpretations 


Varieties  of  CSPs  and  Constraints 


Varieties  of  CSPs 


Discrete  Variables 
Finite  domains 

Size  d means  O(dn)  complete  assignments 

E.g.,  Boolean  CSPs,  including  Boolean  satisfiability  (NP- 

complete) 

Infinite  domains  (integers,  strings,  etc.) 

E.g.,  job  scheduling,  variables  are  start/end  times  for  each 
job 

Linear  constraints  solvable,  nonlinear  undecidable 
Continuous  variables 

E.g.,  start/end  times  for  Hubble  Telescope  observations 
Linear  constraints  solvable  in  polynomial  time 


Varieties  of  Constraints 


► 


Varieties  of  Constraints 

Unary  constraints  involve  a single  variable  (equivalent 
reducing  domains),  e.g.: 

SA  7^  green 

Binary  constraints  involve  pairs  of  variables,  e.g.: 

SA  7^  WA 

Higher-order  constraints  involve  3 or  more  variables: 

Preferences  (soft  constraints): 

E.g.,  red  is  better  than  green 

Often  representable  by  a cost  for  each  variable 

assignment 

Gives  constrained  optimization  problems 


Real-World  CSPs 


Assignment  problems:  e.g.,  who  teaches  what  class 
Timetabling  problems:  e.g.,  which  class  is  offered  when  and  where? 
Hardware  configuration 
Transportation  scheduling 
Factory  scheduling 
Circuit  layout 
Fault  diagnosis 
...  lots  more! 


Many  real-world  problems  involve  real-valued  variables... 


Solving  CSPs 


► 

► 


Standard  Search  Formulation 


Standard  search  formulation  of  CSPs 


We’ll  start  with  the  straightforward,  then 
improve  it 


States  defined  by  the  values  assigned  so  far 
(partial  assignments) 

Initial  state:  the  empty  assignment,  {} 

► Successor  function:  assign  a value  to  a 
single  unassigned  variable 

Goal  test:  the  current  assignment  is 
complete  and  satisfies  all  constraints 


Search  Methods 


What  would  BFS  do? 


What  would  DFS  do? 


What  problems  does 


naYve 


search 


have? 


[Demo:  coloring  --  dfs] 


Thanks 


